chore: sync workflow templates by stranske · Pull Request #607 · stranske/Template

stranske · 2026-04-26T09:40:29Z

Sync Summary

Files Updated

agents-81-gate-followups.yml: Gate followups hub - consolidates keepalive and autofix followups
agents-bot-comment-handler.yml: Bot comment handler - dispatches agents to address bot review comments (deprecated; replaced by agents-80-pr-event-hub.yml, removal no earlier than 2026-02-15)
agents-weekly-metrics.yml: Weekly metrics - aggregates auto-pilot, keepalive, autofix and verifier metrics into summary reports
aggregate_agent_metrics.py: Aggregates downloaded weekly agent metrics - required by agents-weekly-metrics.yml
terminal_disposition.js: Machine-readable terminal disposition records and source summaries
terminal_disposition_coverage.js: Warning-only terminal disposition source coverage preflight
bot_comment_auth_coverage.js: Warning-only bot-comment App auth coverage preflight
coverage_monitor_summary.js: Machine-readable weekly coverage monitor checkpoint
weekly_metrics_artifacts.js: Bounded weekly metrics artifact selection contract
weekly_metrics_download_manifest.js: Weekly metrics artifact download and extraction manifest contract
agents_pr_meta_update_body.js: Updates PR body with agent metadata

Files Skipped

pr-00-gate.yml: File exists and sync_mode is create_only
ci.yml: File exists and sync_mode is create_only
dependabot.yml: File exists and sync_mode is create_only
llm_slots.json: None

Review Checklist

CI passes with updated workflows
No repo-specific customizations were overwritten

Source: stranske/Workflows
Manifest: .github/sync-manifest.yml

Automated sync from stranske/Workflows Template hash: 2e01e11c7edc Changes synced from sync-manifest.yml

agents-workflows-bot · 2026-04-26T09:41:02Z

⚠️ Action Required: Unable to determine source issue for PR #607. The PR title, branch name, or body must contain the issue number (e.g. #123, branch: issue-123, or the hidden marker ).

stranske-keepalive · 2026-04-26T09:42:11Z

🤖 Keepalive Loop Status

PR #607 | Agent: Codex | Iteration 0/5

Current State

Metric	Value
Iteration progress	[----------] 0/5
Action	wait (missing-agent-label)
Disposition	skipped (transient)
Gate	success
Tasks	0/15 complete
Timeout	45 min (default)
Timeout usage	5m elapsed (12%, 40m remaining)
Keepalive	❌ disabled
Autofix	❌ disabled

🔍 Failure Classification

stranske-keepalive · 2026-04-26T09:42:12Z

Keepalive Work Log (click to expand)

Time (UTC)	Agent	Action	Result	Files	Progress	Commit	Gate
2026-04-26 09:42:12	Codex	wait (missing-agent-label-transient)	skipped	—	0/15	—	—
2026-04-26 09:44:54	Codex	wait (missing-agent-label-transient)	skipped	—	0/15	—	cancelled
2026-04-26 09:45:31	Codex	wait (missing-agent-label-transient)	skipped	—	0/15	—	cancelled
2026-04-26 09:46:02	Codex	wait (missing-agent-label-transient)	skipped	—	0/15	—	success

Copilot

Pull request overview

This PR syncs workflow templates and metrics tooling from stranske/Workflows, extending weekly metrics collection with richer artifact-download accounting, machine-readable summary contracts, and expanded terminal-disposition/bot-auth coverage reporting.

Changes:

Add a weekly metrics artifact download manifest (JSON + markdown) and publish a machine-readable aggregated metrics contract alongside the markdown summary.
Expand terminal disposition coverage to include verifier-model compatibility checks and surface priority artifact-family status in reports.
Emit a wrapper terminal-disposition record from the bot-comment-handler wrapper workflow and enrich PR meta preamble with source-issue closing metadata.

Reviewed changes

Copilot reviewed 11 out of 11 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
`scripts/aggregate_agent_metrics.py`	Enriches NDJSON parsing with source metadata, detailed parse errors, verifier-model stats, and outputs a JSON summary contract.
`.github/workflows/agents-weekly-metrics.yml`	Generates and uploads selection + download-manifest artifacts; produces both markdown and JSON weekly metrics outputs.
`.github/workflows/agents-bot-comment-handler.yml`	Adds skip-reason output and emits/uploads a wrapper terminal-disposition NDJSON + markdown summary.
`.github/workflows/agents-81-gate-followups.yml`	Switches keepalive metrics JSON emission to compact (`jq -cn`) output suitable for NDJSON usage.
`.github/scripts/weekly_metrics_download_manifest.js`	New utility to initialize/record/finalize a structured artifact download manifest and render it as markdown.
`.github/scripts/weekly_metrics_artifacts.js`	Adds “missing priority families” and per-priority-family status details to the artifact selection report/markdown.
`.github/scripts/terminal_disposition_coverage.js`	Adds verifier-model compatibility summary and improved artifact-selection normalization/markdown output.
`.github/scripts/terminal_disposition.js`	Adds normalized fields for `llm_model`, `model_selection_reason`, and `verifier_mode` on terminal disposition records.
`.github/scripts/coverage_monitor_summary.js`	New weekly coverage monitor contract summarizing terminal + bot-auth coverage reports.
`.github/scripts/bot_comment_auth_coverage.js`	Adds reusable-invocation expectation fields and richer organic-evidence reporting (skipped/missing requirements).
`.github/scripts/agents_pr_meta_update_body.js`	Adds an issue metadata marker and “Closes #…” line to the PR preamble when a source issue is present.

Copilot · 2026-04-26T09:46:08Z

+        file_entries: list[dict[str, Any]] = []
+        file_errors: list[ParseErrorDetail] = []
+        raw_lines: list[str] = []
        with handle:
-            for line in handle:
+            for line_number, line in enumerate(handle, start=1):
                raw = line.strip()
                if not raw:
                    continue
+                raw_lines.append(raw)
                try:


In _read_ndjson, raw_lines is populated for every non-empty line even when the file is valid NDJSON. For larger artifacts this duplicates the entire file content in memory unnecessarily. Consider only collecting raw_lines when you actually need the whole-file fallback parse (e.g., only while file_entries is still empty and a parse error has been observed, and/or cap the number of collected lines).

Copilot · 2026-04-26T09:46:08Z

+def _parse_error_contract(parse_error_details: list[ParseErrorDetail]) -> dict[str, Any]:
+    family_counts = Counter(detail.artifact_family for detail in parse_error_details)
+    artifact_counts = Counter(detail.artifact for detail in parse_error_details)
+    reason_counts = Counter(detail.reason for detail in parse_error_details)
+    return {
+        "count": len(parse_error_details),
+        "by_artifact_family": dict(sorted(family_counts.items())),
+        "by_artifact": dict(sorted(artifact_counts.items())),
+        "by_reason": dict(sorted(reason_counts.items())),
+        "details": [detail.as_dict() for detail in parse_error_details],
+    }


_parse_error_contract includes a details array containing every parse error. Combined with _read_ndjson recording an error per bad line, a single corrupted/large input can produce a very large JSON summary (and high memory usage). Consider bounding details (and/or the collected parse errors) and adding an omitted_count/truncated indicator so the contract remains safe to upload and consume.

Copilot · 2026-04-26T09:46:09Z

+      - name: Write wrapper terminal disposition
+        if: always()
+        env:
+          RESOLVED_PR_NUMBER: ${{ steps.resolve.outputs.pr_number }}
+          REUSABLE_INVOCATION_EXPECTED: ${{ steps.resolve.outputs.should_run }}
+          SKIP_REASON: ${{ steps.resolve.outputs.skip_reason }}
+        run: |
+          mkdir -p agent-metrics
+          node <<'NODE'
+          const fs = require('fs');
+          const helperPath = './.github/scripts/terminal_disposition.js';


This job runs ./.github/actions/setup-api-client (which executes node/npm) and later runs an inline node script, but the workflow doesn't set up a pinned Node version first. Other workflows in this repo run actions/setup-node (Node 20) before setup-api-client to avoid relying on whatever Node happens to be preinstalled on ubuntu-latest. Add a Setup Node step (pinned SHA) before Setup API client/the node <<'NODE' invocation.

Copilot · 2026-04-26T09:46:09Z

+      status: selectedCount > 0 ? 'selected' : (candidateCount > 0 ? 'available' : 'missing'),
+      candidate_count: candidateCount,
+      selected_count: selectedCount,
+      latest_candidate: selectedArtifact ? normalizeSelectionArtifact(selectedArtifact) : null,


In the backward-compatibility branch of normalizeTerminalPriorityFamilyStatuses, latest_candidate is set from selectedArtifact (and is left null when only candidates exist but nothing selected). This makes the field semantically misleading and can hide useful “latest available” info. Consider leaving latest_candidate null in this fallback (or deriving it from report.priority_family_statuses/other available metadata) and only populating selected_artifact from selectedArtifact.

Suggested change

latest_candidate: selectedArtifact ? normalizeSelectionArtifact(selectedArtifact) : null,

latest_candidate: null,

chore: sync workflow templates from Workflows repo

b87e500

Automated sync from stranske/Workflows Template hash: 2e01e11c7edc Changes synced from sync-manifest.yml

Copilot AI review requested due to automatic review settings April 26, 2026 09:40

stranske added sync Automated sync from Workflows automated Automated sync from Workflows labels Apr 26, 2026

stranske temporarily deployed to agent-standard April 26, 2026 09:40 — with GitHub Actions Inactive

stranske temporarily deployed to agent-standard April 26, 2026 09:41 — with GitHub Actions Inactive

Copilot started reviewing on behalf of stranske April 26, 2026 09:41 View session

Copilot AI reviewed Apr 26, 2026

View reviewed changes

stranske mentioned this pull request Apr 26, 2026

Sync/Dependency campaign queue stranske/Workflows#1836

Open

This was referenced Apr 26, 2026

fix: harden verifier metrics and artifact downloads stranske/Workflows#1893

Merged

Fix sync campaign issue reuse and marker size stranske/Workflows#1896

Merged

stranske mentioned this pull request Apr 26, 2026

Sync/Dependabot campaign queue stranske/Workflows#1897

Closed

agents-workflows-bot Bot mentioned this pull request Apr 26, 2026

[codex] Suppress non-opt-in keepalive comments stranske/Workflows#1906

Merged

17 tasks

stranske closed this Apr 29, 2026

agents-workflows-bot Bot deleted the sync/workflows-2e01e11c7edc branch May 14, 2026 19:30

Navigation Menu

chore: sync workflow templates - #607

chore: sync workflow templates#607
stranske wants to merge 1 commit into
mainfrom
sync/workflows-2e01e11c7edc

stranske commented Apr 26, 2026

Uh oh!

agents-workflows-bot Bot commented Apr 26, 2026

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 •

edited by agents-workflows-bot Bot

Loading

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 •

edited by agents-workflows-bot Bot

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

	latest_candidate: selectedArtifact ? normalizeSelectionArtifact(selectedArtifact) : null,
	latest_candidate: null,

Conversation

stranske commented Apr 26, 2026

Sync Summary

Files Updated

Files Skipped

Review Checklist

Uh oh!

agents-workflows-bot Bot commented Apr 26, 2026

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 • edited by agents-workflows-bot Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🤖 Keepalive Loop Status

Current State

🔍 Failure Classification

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 • edited by agents-workflows-bot Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

stranske-keepalive Bot commented Apr 26, 2026 •

edited by agents-workflows-bot Bot

Loading

stranske-keepalive Bot commented Apr 26, 2026 •

edited by agents-workflows-bot Bot

Loading